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(57) ABSTRACT 

In interactive television, information from an information 
resource may be displayed along with television video in a 
synchronized fashion. When information is to be displayed 
at a point in the television video, a Uniform Resource 
Identifier (UR1) that identifies the information resource is 
broadcast along with the television video on a one-way 
broadcast communication channel. A receiver unit receives 
the URI from the broadcast channel. If the information 
resource identified by the URI is available locally (for 
example, is present in local storage on the receiver unit), 
then the receiver unit uses the URI to retrieve the informa- 
tion resource locally. If, on the other hand, the information 
resource is not available locally, then the receiver unit uses 
the URI to retrieve the information resource from the 
Internet. The information resource can therefore be received 
from a high speed source (for example, from VBI lines 
10-20) if such reception is possible, but if such reception is 
not possible then the information resource can be retrieved, 
from another source (for example, from the Internet). Once 
the receiver unit has retrieved the information resource, the 
receiver unit can display the information along with the 
television video. 

30 Claims, 5 Drawing Sheets 
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RECEIVING AN INFORMATION RESOURCE 
FROM THE INTERNET IF IT IS NOT 
RECEIVED FROM A BROADCAST 
CHANNEL 

BACKGROUND INFORMATION 

Broadcast television in the United States is broadcast in 
accordance with the NTSC (National Television Standards 
Committee) broadcast television format standard. 
Approximately, thirty image frames are transmitted each 
second. The NTSC signal for a single frame consists of two 
interlaced fields of 262.5 horizontal scan lines each. FIG. 1 
(Prior Art) is a simplified diagram of an NTSC field 100 
having 262.5 horizontal scan lines. Only a viewable portion 
101 of the field communicates the image. 

Broadcast and display of field 100 is described in con- 
nection with a conventional analog television set having a 
cathode ray tube (CRT) with an electron beam. Receiver 
electronics in the television receives the broadcast NTSC 
signal and controls the electron beam-so that the electron 
beam is scanned across a screen of the CRT to form the 
image. The first nine horizontal scan lines 102 of the NTSC 
field 100 are used to synchronize the television receiver 
electronics and to return the electron beam to the top of the 
screen. The electron beam is disabled (i.e. "blanked") during 
the scan time of the first twenty-one scan lines so that the 
electron beam does not scribe a visible line from the bottom 
of the screen to the top of the screen when it is being 
returned to the top of the screen. These first twenty-one 
horizontal scan lines are therefore commonly referred to as 
the "vertical blanking interval" lines (VBI lines). 

The odd scan lines of the frame (frame line 1, frame line 
3, frame line 5, and so forth) are received first and in order. 
These odd scan lines are called the "odd field". The first 
twenty -one of these odd lines are VBI lines. These first lines 
are used, among other things, to synchronize, the television 
receiver for the subsequent scanning of the horizontal scan 
lines of the viewable portion 101. For each horizontal scan 
line, the electron beam in the television scans from left to 
right across the screen. After the beam has reached the right 
edge of the screen, the electron beam is returned to the left 
edge of the screen in preparation for the scanning of the next 
scan line. After the scanning of each odd scan line in 
viewable portion 101, the electron beam is "blanked" for an 
appropriate period of time so that the beam can be returned 
to the left edge of the screen in preparation for the next scan. 
The sum total of the time of these blankings is referred to as 
a horizontal blanking interval of the field. Region 103 of 
field 100 corresponds to the sum of the horizontal blanking 
interval times of all the scan lines. 

Next, the even scan lines of the frame (frame line 2, frame 
line 4, frame line 6, and so forth) are received in order. As 
with the odd field, the first twenty-one scan lines of the even 
field are VBI lines. The electron beam is "blanked" during 
the scanning of these even VBI lines so that the electron 
beam can be returned to the top of the screen without 
scribing a line on the screen. After the scanning of the even 
VBI lines, the even scan lines of viewable portion 101 are 
then scanned in similar fashion to the scanning of the odd 
scan lines. The viewable horizontal scan lines of the odd and 
even fields together cause the electron beam to scan across 
the screen of the television to create the viewable television 
image. 

The entire vertical blanking interval is generally not, 
however, required for vertical synchronization and vertical 
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beam retrace. Only VBI lines 1-9 of a field are generally 
used for these purposes. The other twelve VBI lines 10-21 
of the field are therefore available for the communication of 
other information. 

VBI line 21, for example, provides a low speed commu- 
nication sub-channel (hereinafter referred to as the "line 21 
sub-channel"). Data is encoded in the line 21 sub-channel at 
a data rate of two bytes per line in accordance with the 
encoding technique set forth in EIA-608. The Federal Com- 
munication Commission (FCC) mandates that line 21 is 
reserved for captioning services as specified by EIA-608. 
The line 21 sub -channel is in turn divided into multiple 
sub -sub-channels. Four of these sub-sub-channels (Tl, T2, 
T3 and T4) are used to carry textual information. Another of 
these sub-sub-channels (XDS) is used to carry other infor- 
mation such as the current time and "V-chip" program rating 
codes. Four other of these sub -sub -channels (CC1, CC2, 
CC3 and CC4) are used to carry closed captioning informa- 
tion. A television receiver can capture the closed captioning 
information of one such sub -sub -channel and display it as a 
text subtitle along with the television video to assist the 
hearing impaired. 

VBI lines 10 through 20, on the other hand, are available 
for a higher speed communication sub -channel for the 
communication of data. Data may be encoded in VBI lines 
10 through 20 at a data rate of approximately thirty-six bytes 
per line in accordance with the NABTS (North American 
Basic Teletext Specification) teletext system standard set 
forth in EIA-516. The sub-channel of VBI lines 10-20 is 
therefore hereinafter referred to as the "teletext sub- 
channel". Due to there being eleven of these VBI lines per 
field, there being sixty fields per second, there being about 
thirty-six. bytes of data per line, there being eight bits per 
byte, and an error correction mechanism being employed, 
the teletext sub -channel has a maximum data rate of 
approximately 100,000 error-corrected bits per second. 

It has been desired to synchronize the display of web 
(HTML or XML) pages to broadcast television video so that 
an appropriate web page can be viewed along with a 
predetermined part of the television video. One approach 
has been to broadcast web page content over the high speed 
teletext sub-channel. The amount of web page content is 
significant so the use of the high speed teletext sub-channel 
has been considered appropriate. After the web page content 
has been received, it is stored locally in the receiver under 
a file name for later access. Next, when the web page content 
is to be displayed at a particular time in the television video, 
a "trigger" that contains the file name of the web page 
content is broadcast over the teletext sub-channel. When the 
trigger is received, the file name of the trigger is used to 
retrieve the associated file containing the web page content 
from local storage so that the web page can be displayed. 

The reception of web pages over the teletext sub-channel 
can, however, be somewhat unreliable. Cable television 
operators or local broadcast stations may use certain of VBI 
lines 10-20 for their own purposes, thereby interfering with 
the communication of web page content on these VBI lines. 
Moreover, televisions disposed in some geographical loca- 
tions may not receive VBI lines 10-20 in a consistent 
fashion. If VBI lines 10-20 are not reliably received, then 
the web page content that was broadcast over those VBI 
lines will not be present in local storage and cannot be 
displayed. In another scenario, web page content is received 
over VBI lines 10-20 but the trigger to display that web page 
content is not. In such a situation, the web page content is 
present in local storage, but the web page content is not 
displayed due to the failure to receive the required trigger. A 
solution is desired. 
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SUMMARY broadcast communication channel. If an information 
TTie line 21 sub-channel (VBI line 21) is subject to resource ( for sample, web page content) identified by the 
government regulation. Care is taken to insure that VBI line URI is P««m on a higher speed but relatively less reliable 
21 and the closed captioning information it carries can be sub-channel (for example, the higher speed teletext sub- 
received reliably by televisions throughout most broadcast 5 chanDel afforded by VBI lmes 10-20 ), then the receiver unit 
regions. The line 21 sub-channel can therefore be considered obUins information resource from the higher speed 
to be a relatively reliable communication sub-channel in sub-channel. If, on the other hand, the information resource 
comparison to the teletext sub-channel. 15 not obtained from the higher speed sub-channel (for 
w j ... . j. . .. example, because the information resource was not broad- 
In accordance with some embodiments, a receiver unit * A L * L j LL f . • 

tl _ . j . t . , , 10 cast on the higher speed sub-channel or because the liifor- 

momtors the one-way broadcast communication channel , r » • j\ .i. 

/r i *l * i / * u u i £c j j u \tth v mation resource was not successfully received), then the 

(for example, the teletext sub-channel afforded by VBI lines . TTT1T . ' 4 . /' 

in • f *• u *u » •* - c receiver unit uses the URI to retrieve the information 

10-20) for information resources such that if an information - T . . ™ . 4 iL c 

' ,c it. * a * £.11 resource from the Internet. The receiver unit therefore 

resource (for example, web page content) is successfully Ut . - . - . * _ . , 4 . , 

« , i . *l *i_ • <• *• obtains the mformation resource from the broadcast channel 

received by the receiver unit, then the information resource „ , £ . 4 . , , , 4 4 , . 4 . it _ . 

. . j * i i * ■ *l • •* • • 15 if it is able, but otherwise retrieves the mformation resource 

is stored in local storage in the receiver unit m association ^ rom ^ j nternet 

with a Uniform Resource Identifier (URI), The URI is, in 

one embodiment, a Uniform Resource Locator * (URL). In another embodiment, television video from a one-way 
Web page content may, for example, be received using a broadcast television channel is recorded onto a magnetic 
tuner of a WebTV® set-top box and may then be stored in „ n medmm ( for exam P le > ^ a ™ cassette infor- 
mal storage (for example, on a hard disk or in semicon- 20 ma u U ° n resourc , e ( for cxample ; wet content) from a first 
ductor memory of the WebTV® set-top box). For additional ^-channel of the one-way broadcast channel is only par- 
detail on a WebTV® set-top box, see U.S. Pat. No. 6,400, tiall y recorded onto the magnetic medium (for example, due 
407, entitled "Communicating Logical Addresses Of to Citations of the VHS recording process , whereas a 
Resources In A Data Service Channel Of A Video Signal", „ resou y ce ldentlfie [ from a second 1 ^b-channel of the one- 
issued Jun. 4, 2002, to Daniel J. Zigmond et al. (the subject 25 wa ? broadcast chan A Del 15 completely recorded onto the 
matter of which is incorporated herein by reference). ma 5 netlc mecbum ; (A resource identifier identifies an infor- 
„ 7 , . c • , ■ 4 mation resource. A URL identifies an information resource 
When the information resource is to be used to augment . . , *u 
tu *u * i ■ ■ • a <c i u *u by specifying a location of the information resource on the 
the viewing of the television video (for example, when the * * , e „ 7 . , 4 , c . , „ 
. c ° , V t ,5. , World Wide Web and therefore is a particular type of 
information resource is web page content and that web page ™ i lC \ 
. i • j. j * i , i , ./ * 30 resource identifier.) 
content is to displayed as a web page along with the 7 

television video), a URI (a resource identifier) is sent over WneD the television video is to be viewed, the magnetic 

the one-way broadcast communication channel. If the URI medium is played back. Although all the information 

is received and the associated information resource is resource was not recorded onto the magnetic medium, the 

present in local storage, then the URI is used to retrieve the 35 resource identifier stored on the magnetic medium is used to 

information resource from local storage. If the information retrieve the mformation resource from the Internet. Once 

resource is web page content, then the web page content can retrieved, the information resource is used to augment the 

be displayed on the television screen as a web page along viewing of the television video. In this way, a viewer of a 

with the television video VHS cassette tape can have an interactive television 

If, on the other hand, the URI is received but for some 40 experience even though all of the information resource is 

reason the associated information resource is not present in not recorded on the VHS cassette tape. 

local storage (for example, the information resource was not This summary does not purport to define the invention. 

successfully received by the receiver unit), then the URI is The invention is defined by the claims. 

used to retrieve the missing information resource from the DDTCC nc0 p DTDTmKI -rue no awtw-c 

t . , i i i • » ,1 . tt t . BRIEF DESCRIPTION OF THE DRAWINGS 

Internet. In some embodiments, the receiver unit attempts to 45 

retrieve the information resource from local storage using FIG. 1 (Prior Art) is a simplified diagram of a field in 

the URI and if the receiver unit is unable to retrieve the accordance with the NTSC standard for broadcast television. 

information resource, then the receiver unit uses the URI to FIG 2 is a diagram of a system 200 in accordance with 

retrieve the information resource from the Internet. In other an embodiment of the present invention. 

embodiments, the receiver unit does not attempt to retrieve 50 piG 3 ig a flowchart Qf a method - n accordance with an 

the information resource from local storage bu rather deter- embodiment of me t mvention> 

mines if the information resource is present in local storage. .11,. c LJ . 

If the receiver unit determines that the information resource FIG - 4 ^ a block diagram of an embodiment of the 

is not present, then the receiver unit uses the URI to retrieve receiver unit 201 of FIG. 2. 

the informauon resource from the Internet. 5S FIG. 5 is a flowchart of a method in accordance with 

After the receiver unit has retrieved the information another embodiment, 

resource from the Internet, the information resource is used FIG. 6 is a flowchart of a method in accordance with 

to augment the viewing of the television video. If the another embodiment. 

information resource is web page content, then the web page FIG. 7 is a block diagram of an exemplary operating 

content can be displayed as a web page along with the eo environment for an embodiment of the present invention 

television video. In this way, the web page content is (such as, for example, WebTV® for Windows), 
retrieved and displayed along with the television video even 

if the web page content was not successfully received over DETAILED DESCRIPTION 

the broadcast channel. FIG. 2 is a simplified diagram of system 200 in accor- 

In another embodiment, a URI is received on a receiver 65 dance with an embodiment of the present invention. System 

unit from a relatively reliable but low speed sub-channel (for 200 includes a receiver unit 201, a television set 202, and a 

example, over the VBI line 21 sub-channel) of a one-way remote control unit 203. Receiver unit 201 uses television 
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set 202 as a display device for displaying video and other (XTVEF) Draft Version 1.1, revision 26 specification (the 

data that is transmitted to the television set via video link content of these documents is incorporated herein by 

204. Although the receiver unit 201 is illustrated here as a reference). 

separate unit from the television set 202, the receiver unit Digital processor 303 stores information resource 301 

201 can be built into the television set as an integral unit. 5 obtained from the broadcast channel in local storage 304. 

Remote control unit 203 can take any one of numerous Local storage 304 may, for example, be semiconductor 

suitable forms including a hand-held remote as illustrated or memory, (for example, random access memory (RAM)) 

a wireless keyboard that is linked to receiver unit 201 by an and/or a storage disk (for example, a magnetic disk or an 

infrared communication link. optical disk). In one embodiment, local storage 304 is a hard 

Receiver unit 201 receives information from a one-way 10 disk and information resource 301 is stored on the hard disk 

broadcast communication channel. In the illustrated as a file having a filename. The filename includes a field 

example, the one-way broadcast communication channel is containing a resource identifier and the resource identifier 

provided by a broadcast television signal 205. A television identifies information resource 301 on the Internet, 

signal 207 is broadcast as a wave through the air 208, is If t on the other hand, information resource 301 is not 

received on an antenna 209 as one-way broadcast signal 205, 15 successfully received by receiver unit 201, then receiver unit 

and is supplied to receiver unit 201 via input 206. One-way 201 is unable to store the broadcast information resource 

broadcast signal 205 need not, however, be transmitted to 301 in local storage 304. Information resource 301 may, for 

the receiver unit 201 as an airborne wave. One-way broad- example, have been transmitted over airwaves 208 but was 

cast signal 205 may, for example, be transmitted to receiver f or some reason not successfully received. Alternatively, the 

unit 201 over any suitable transmission medium, including 20 content provider may not have encoded the information 

fiber optic links, coaxial cables, wave guides, and twin-wire resource 301 into the broadcast signal. In either case, 

transmission lines. information resource 301 from the broadcast signal is not 

Receiver unit 201 is coupled to the Internet 210 via a stored in local storage 304. 

two-way communication link 211. Two-way communication Next (step 305), the receiver unit 201 receives a resource 

link 211 may, for example, be a POTS (plain old telephone 25 identifier 306 (see FIG. 2) from the broadcast channel. This 

system) connection, an Integrated Services Digital Network resource identifier 306 identifies the information resource 

(ISDN) connection, a Tl connection, or a cable modem. 301 on the Internet. In one embodiment, information 

Receiver unit 201 is powered with AC power via a power resource 301 is HTML code defining a web page on the 

line 212. In some embodiments, receiver unit 201 is both World Wide Web and resource identifier 306 is a Uniform 

coupled to the Internet and also receives broadcast television 30 Resource Locator (URL) that is broadcast over VBI line 21 

signals from a single cable or fiber optic link via a cable of the NTSC format broadcast television channel in accor- 

modem. dance with: 1) the Transport of Internet Uniform Resource 

FIG. 3 is a simplified flowchart of a method in accordance Locator (URL) Information Using Text-2 (T-2) Service 

with an embodiment of the present invention. First (step 35 standard EIA-746-A; and 2) the Recommended Practice for 

300), receiver unit 201 monitors the one-way broadcast Line 21 Data Service standard EI A-608 (the content of these 

communication channel for information resources such that two documents is incorporated herein by reference), 

if an information resource 301 (see FIG. 2) is received from Of course, alternative means of uniquely identifying an 

the one-way broadcast communication channel, then information resource may be employed. For example, it is 

receiver unit 201 obtains the information resource 301 from 40 appreciated that keys (e.g. database indices), network 

the broadcast channel and stores the information resource in addresses (e.g. addresses), and other identification 

local storage in receiver unit 201 . The information resource mechanisms, alone or in combination, may be employed to 

301 may, for example, be HTML (HyperText Markup uniquely identify an information resource. 

Language) or XML (Extensible Markup Language) web Next (step 306), if information resource 301 is present in 

page content that is encoded into VBI lines 10-20 of an 45 local storage 304 on receiver unit 201, then receiver unit 201 

NTSC format broadcast television channel. uses resource identifier 306 to retrieve the information 

FIG. 4 is a block diagram of one embodiment of receiver resource 301 from local storage 304. In an embodiment 

unit 201. Information resource 301 is communicated over where information resource 301 is stored in local storage 

the one-way broadcast communication channel to TV inter- 304 under a filename containing a URL of the information 

face circuitry 302 in receiver unit 201. TV interface circuitry 50 resource 301, digital processor 303 uses a URL received in 

302 includes a tuner that is tuned to receive the broadcast step 305 to retrieve the file containing the information 
channel signal. The tuner removes the carrier signal. After resource 301 from local storage 304. 

the carrier signal is removed, the TV interface circuitry 302 if, 0 n the other hand, information resource 301 is not 

digitizes the signal. Software executed by a digital processor stored in local storage 304 under the URI received in step 

303 receives the digitized signal from TV interface 302 and 55 305, then digital processor 303 is unable to retrieve the 
decodes and checks the digitized signal for errors thereby information resource. Again, this may be due to the fact the 
recovering the information resource 301. Information information resource being transmitted was not successfully 
resource 301 is then said to have been successfully received received or may be due to the information resource never 
by the receiver unit 201. having been transmitted over the broadcast channel. 

Decoding software in digital processor 303 may be real- 60 Next (step 307), if information resource 301 is not present 

ized with reference to and in accordance with: NABTS in local storage 304, then receiver unit 201 uses resource 

("teletext") standard EIA-516 that describes how data is identifier 306 to retrieve information resource 301 from the 

encoded in VBI lines 10-20; the IPVBI draft of February Internet 210. In one embodiment, digital processor 303 

1999 entitled "The Transmission Of IP Over The Vertical includes software similar to a web browser. This software 

Blanking Internal Of A Television Signal" that describes 65 receives a URL (one type of URI) as an input and then 

how to decode IP packets from VBI lines 10-20; and the retrieves HTML web content identified by the URL from the 

Advanced Television Enhancement Forum Specification Internet. Digital processor 303 is coupled to the Internet via 
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a modem 310. Modem 310 can be any suitable modem The second event is a downloading event wherein infor- 

inchiding a standard telephone modem, an ISDN modem, or mation resource 301 is communicated to receiver unit 201 in 

a cable modem. After receiver unit 201 has retrieved the compressed format. A downloading message is sent to the 

HTML web content, receiver unit 201 can display the receiver to inform the receiver unit when the downloading 

HTML web content on the screen of the television 202 as a 5 will start. Data is transferred as a series of Unidirectional 

web page 308 concurrently with the broadcast television Hypertext Transfer Protocol (UHTTP) packets. 

yjjgQ Alternatively, BFTP, DSM/CC, and other protocols can be 

_ j • ™^ • j • t . .. . used. CRC error detection codes are included with the data 

In an example illustrated in FIG. 2, it is desired to ^phy ^ ^ ^ ^ ^ detennine whelhef ^ data has 

web page 308 along wjth the television video 309 (in this be6Q ^p,^. ^ informaU o n resource may be sent mid- 
cue a baseball game) at an appropriate time in the television w ^ times sQ ^ of ^ information resource that were 
video. First an attempt is made to transmit information , ed on lhe flrst broadcast can be received successfully 
resource 301 (HTML web content which >f delayed 0Q sub U6Qt broadcasts to reconstruct the complete uncor- 
appears as wet. page 308) to the receiver uml 201 over VBI d inforrnation resource . If the information resource 301 
lines 10-20 of anNISC broadcast channel. The commuru- fa successfully received then lhe information resource 301 
cation channel afforded by VBI lines 10-20 is considered to 15 ^ s(ored at , he 1(Jcation ifled b the 
be a first sub-channel of the NTSC broadcast television ™, , 4 . , A . . A 
channel e r eveDt 15 an °P llona l decompressing event. A 

decompressing message is sent to the receiver unit to inform 

Information resource 301, if successfully received, is the receiver ^ that down i oading ^ complete, that the 

stored in receiver unit 201 in association with its URL (a receiver unit is to decompress the identified information 

URI). Then, at the appropriate time during the television reS ource 301 just downloaded, and that the identified infor- 

video, the URI of information resource 301 is transmitted to ma tion resource 301 should be decompressed by a specified 

receiver unit 201 over VBI line 21 of the NTSC broadcast (j me 

channel. The communication channel afforded by VBI [line ^ fourth eyent {$ me « trigger » ^ e trigger instructs me 
21 is considered to be a second sub-channel of the NTSC feceiver ^ 201 to use fte mformation resource identified 
broadcast television channel. Hie URI is a trigger or is a part b a resource identifier - n ^ trf (f()r ex ^ a file 
of a trigger that instructs receiver unit 201 to display the name where ^ ^0^^ resource ^ st0 red-the file 
designated informaUon resource HTML web content. name a URL where the information resource can 
Receiver unit 201 uses the URI to retrieve information alsQ be found 0Q me Intemet) tQ fl t the yiewi of 
resource 301 (in this case, HTML web page content) from television video . trigger is carried in a single UD P/IP 
local storage 304. In the event information resource 301 is muliic ^ t packet< ^ trigger contains an oplional expiration 
not found in local storage 304, then receiver unit 201 uses ^ field that indicales a ^ after wnich the trigger ^ no 
the URI received over VBI line 21 to retrieve information b yaHd The trf ^ contains m tional chccksum 
resource 301 (in this case, HTML web page content) from ^ helps delect corruption of the trigger For additiona i 
Internet Z1U. ^ details on announcements, one-way data downloading, 
After information resource 301 (in this case, HTML web checking for corrupted data, decompressing, and triggers, 
page content) has been retrieved, receiver unit 201 displays se e; the Advanced Television Enhancement Forum Specifi- 
information resource 301 (such as web page 308) along with cat i on (ATVEF) draft version 1.1, revision 26 (the subject 
the television video 309 of the broadcast channel as illus- matter of which is incorporated herein by reference), 
trated in FIG. 2. Web page 308 and the television video 309 4Q In accor d an ce with one embodiment, triggers with URLs 
are merged into a single video stream that is transmitted to associated with large grain changes (for example, major 
the television 202 over video line 204. Audio digital-to- scene charjgcs ) arc broadcast in a slow speed, relatively 
analog converter (DAC) 311 and video encoder 312 convert reliable sub -channel (for example, VBI line 21), whereas 
a digital output stream from digital processor 303 into the triggers with URLs associated with finer grain changes (for 
appropriate analog audio and video signals for use by the 45 example , changing a small part of a scene) are broadcast in 
television set 202. a hj gne r speed, relatively less reliable sub-channel (for 
If, for example, web page 308 includes a button, then a example, VBI lines 10-20 ). In this way, if the higher speed 
viewer can use the remote control unit 203 to click on the relatively less reliable sub-channel is operative, then triggers 
button. By clicking on buttons, a viewer can change televi- for fine grain changes are received over this high speed 
sion channels, customize the display of information on the 50 sub-channel and an enhanced viewing experience is pos- 
television screen, interact with web pages, browse the Web, sible. If, on the other hand, triggers for the finer grain 
send e-mail, and/or access various system network services. changes are not successfuilly received over the high speed 
Remote control unit 203 transmits infrared signals to digital sub-channel, viewers are nevertheless still able to receive 
processor 303 via IR interface 313. triggers for larger grain changes over the low speed sub- 
In formation resource 301 and resource identifier 306 may 55 channel and get the associated large grain changes from the 
be transmitted to and be received by receiver unit 201 in a Internet. Triggers can be selectively enabled and/or disabled 
series of events. The first event is called the "announce- in some embodiments in accordance with techniques set 
ment". The announcement notifies the receiver unit to pre- forth in U.S. Pat. No. 6,480,180, entitled "Enabling And/Or 
pare to receive information resource 301. The announce- Disabling Selected Types Of Broadcast Triggers", issued 
ment may contain a time code that indicates when data is to 60 Oct. 1, 2002, to Timothy Park et al. (the content of which is 
be transmitted. The announcement also includes a fist of incorporated herein by reference). 

specific IP multicast addresses that the receiver unit is to In some embodiments, a trigger for a finer grain change 

monitor and receive content from. The announcement fur- includes a piece of a scripting language that causes a script 

ther includes a resource identifier (for example, a name of a to execute on the receiver unit. Execution of the script 

file where the name of the file contains a URL) that identifies 65 carries out the finer grain change by modifying a part of the 

a place in local storage 304 where information resource 301 web page. Execution of the script may change the HTML 

should be stored. code for a web page so that when that HTML code is 
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displayed by the browser of the receiver unit 201, the web then received and recorded on a cassette tape (for example, 

page includes the finer grain change. Triggers suitable for a VHS tape). When the cassette tape is played back, the web 

making finer grain chnages using scripts are described in page content from VBI lines 10-20 cannot be displayed due 

U.S. patent application Ser. No. 09/287,985, entitled "Com- to the poor quality capture described above. The playback 

municating Scripts In A Data SErvice Channel Of A Video s device however uses the resource identifiers from VBI line 

Signal", filed Apr. 7, 1999, by Dean J. Blackketter and 21 to retrieve the identified web page content from the 

Daniel J. Zigmond (the subject matter of which is incorpo- Internet. The web page content is then displayed as a web 

rated herein by reference). page along with the television video. The viewer can interact 

The method of FIG. 3 sees application in the high with the web page and have an interactive television expe- 

definition television (HDTV) context. In one example, ]0 rience by accessing the Internet as desired through the 

resource identifier 306 is transmitted over a relatively low playback device. 

speed sub-channel of an HDTV channel set forth in the FIG- 6 is a flowchart of a method in accordance with 

Closed Captioning on ATSC (Advanced Television Systems another embodiment. First (step 600), a receiver unit 

Committee) standard EIA-708, whereas information receives television video and a first version of an informa- 

resource 301 is transmitted over a higher speed sub-channel 15 tioD resource from a one-way broadcast communication 

of the HDTV channel channel. In one example, the information resource is 

FIG. 5 is a flowchart of a method in accordance with r v ^ e jYf d ^ om a Channel (VBI lines 10-20) of an 

another embodiment of the present invention. In a first step mSC ^vision broadcast channel, 

(step 500), web page content is transmitted on a first The information resource is then stored (step 601) in local 

sub-channel (for example, VBI lines 10-20 ) of a one-way 20 stora S e " the receiver unit. The information resource may 

broadcast channel and a resource identifier (for example, a be stored ia association with a resource identifier such that 

URL) identifying the web page content is transmitted on a the resource identifier can later be used to retrieve the stored 

second sub-channel (for example, VBI line 21) of the information resource from the local memory. An example of 

one-way broadcast channel. A first receiver receives (step sucn a resource identifier is a URL. 

501) the web content from the first sub-channel and stores 25 The receiver unit then receives a resource identifier from 

the web page content in local storage in association with the the broadcast communication channel (step 602). The 

resource identifier. When the first receiver receives the resource identifier identifies the first version of the informa- 

resource identifier (for example, as part of a trigger) from the tion resource identifier is an interactive television trigger 

second sub-channel (step 502), the receiver unit uses the that contains a URL where .the URL is the resource identifier, 

resource identifier to locate and retrieve the content from its 30 This trigger identifies an information resource where infor- 

local storage. The web page content can then be displayed as mation from the information resource is to be displayed on 

a web page along with television video from the one-way the receiver unit. 

broadcast channel. The receiver unit then determines (step 603) whether the 
In contrast to the first receiver unit that receives the web flrst version of the information resource present in local 
page content from the one-way broadcast channel, a second 35 storage is adequate. This determination can be made in any 
receiver receives the web page content from the Internet. one of numerous different ways using numerous different 
Without having received the web page content from the types of information depending on the particular application, 
one-way broadcast channel and without the web page con- In one particular embodiment, the information resource is a 
tent being stored in local storage on the second receiver unit, wcb page complete with an http header that was used to 
the second receiver unit receives (step 503) the resource 40 transport the web page. An expiration date stamp is con- 
identifier from the second sub-channel. Because the web tained in the meta-information in the http header. The 
page content identified by the resource identifier is not receiver unit uses the resource identifier to retrieve the first 
present in the local storage on the second receiver unit, the version of the information resource from local memory and 
second receiver cannot retrieve the web page content from examines this expiration date stamp. If the expiration date 
its local storage. The second receiver unit therefore uses the 45 stamp indicates that the first version of the information 
resource identifier (for example, a URL that identifies the resource has expired, then the first version of the information 
web page content on the World Wide Web) to retrieve the resource is determined not to be adequate, 
web page content from the Internet (step 504). TAvo receiver If the first version of the information resource in local 
units that receive the same resource identifier therefore storage is determined not to be adequate (step 603), then 
retrieve the identified web page content from different 50 processing proceeds to step 605. The receiver unit uses the 
sources, one receives the web page content from the one- resource identifier (for example, a URL of a trigger received 
way broadcast channel, the other receives the web page in step 602) to retrieve a second version of the information 
content from the Internet. resource from the Internet. In one example, the first version 
In accordance with another embodiment, broadcast tele- of the information resource and the second version of the 
vision video is recorded on a magnetic medium (for 55 information resource have identical URLs but the two 
example, a VHS cassette tape). Although VHS recording versions have different meta-information expiration date 
aptures VBI lines 10-20 to some degree, VHS recording stamps. 

enerally does not capture the higher bandwidth encodings on Next (step 606), information from the second version of 

VBI lines 10-20 well enough to pass an information the information resource is displayed on the receiver unit 

resource (for example, HTML web page content) that may 60 concurrently with the television video received from the 

be encoded there. This is particularly true when the broad- broadcast communication channel. 

cast format is NABTS. In accordance with one embodiment, If, on the other hand, the first version of the information 
web page content and corresponding resource identifiers are resource in local storage is determined to be adequate (step 
broadcast along with television video over a one-way broad- 603), then processing proceeds to step 604 where informa- 
cast communication channel. The web page content is 65 tion from the first version of the information resource is 
broadcast on VBI lines 10-20. The resource identifiers are displayed concurrently with television video from the broad- 
broadcast on VBI line 21. The television broadcast signal is cast communication channel. 
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EXEMPLARY OPERATING ENVIRONMENT: FIG. 7 
and the following discussion are intended to provide a brief, 
general description of a suitable computing environment in 
which the invention may be implemented. Although not 
required, aspects of the various embodiments are described 
in the general context of computer-executable instructions, 
such as program modules, being executed by a digital 
processor. The digital processor may, for example, be a part 
of a personal computer that executes program modules. 
Generally, program modules include routines, programs, 
objects, components, data structures, etc. that perform par- 
ticular tasks or implement particular abstract data types. 
Moreover, those skilled in the art will appreciate that the 
invention may be practiced with other system 
configurations, including hand -held devices, multiprocessor 
systems, microprocessor-based or programmable consumer 
electronics, network PCs, minicomputers, mainframe 
computers, and the like. The invention may also be practiced 
in distributed computing environments where tasks are 
performed by remote processing devices that are linked 
through a communications network. In a distributed com- 
puting environment, program modules may be located in 
both local and remote memory storage devices. 

With reference to FIG. 7, an exemplary computing system 
for implementing the invention includes a general purpose 
computing device in the form of a conventional personal 
computer 720, including a processing unit 721, a system 
memory 722, and a system bus 723 that couples various 
system components including the system memory to the 
processing unit 721. The system bus 723 may be any of 
several types of bus structures, including a memory bus or 
memory controller, a peripheral bus, and a local bus using 
any of a variety of bus architectures. The system memory 
includes read only memory (ROM) 724 and random access 
memory (RAM) 725. A basic input/output system 726 
(BIOS), containing the basic routines that help to transfer 
information between elements within the personal computer 
720, such as during start-up, is stored in ROM 724. The 
personal computer 720 further includes a hard disk drive 727 
for reading from and writing to a hard disk, not shown, a 
magnetic disk drive 728 for reading from or writing to a 
removable magnetic disk 729, and an optical disk drive 730 
for reading from or writing to optical disk 731 such as a CD 
ROM or other optical media. The hard disk drive 727, 
magnetic disk drive 728, and optical disk drive 730 are 
connected to the system bus 723 by a hard disk drive 
interface 732, a magnetic disk drive interface 733, and an 
optical drive interface 734, respectively. The drives and their 
associated computer-readable media provide nonvolatile 
storage of computer readable instructions, data structures, 
program modules and other data for the personal computer 
720. Although the exemplary environment described herein 
employs a hard disk, a removable magnetic disk 729 and a 
removable optical disk 731, it should be appreciated by 
those skilled in the art that other types of computer readable 
media which can store data that is accessible by a computer, 
such as magnetic cassettes, flash memory cards, digital 
video disks, Bernoulli cartridges, random access memories, 
read only memories, and the like, may also be used in the 
exemplary operating environment, 

A number of program modules may be stored on the hard 
disk, magnetic disk 729, optical disk 731, ROM 724 or 
RAM 725, including an operating system 735, one or more 
application programs 736, other program modules 737, and 
program data 738. Web content including HTML files in 
compressed format or in uncompressed format may be 
stored on the hard disk 727. A user may enter commands and 
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information into the personal computer 720 through input 
devices such as a keyboard 740 and pointing device 742. 
Other input devices (not shown) may include a microphone, 
joystick, game pad, satellite dish, scanner, or the like. These 
and other input devices are often connected to the processing 
unit 721 through a serial port interface 746 that is coupled 
to the system bus, but may be connected by other interfaces, 
such as a parallel port, game port or a universal serial bus 
(USB). A monitor 747 or other type of display device is also 
connected to the system bus 723 via an interface, such as a 
video adapter 748. Web content and television video may be 
displayed concurrently on monitor 747 in some embodi- 
ments. In addition to the monitor, personal computers typi- 
cally include other peripheral output devices (not shown), 
such as speakers and printers. 

The personal computer 720 may operate in a networked 
environment using logical connections to one or more 
remote computers, such as a remote computer 749. The 
remote computer 749 may be another personal computer, a 
server, a router, a network PC, a peer device or other 
common network node, and typically includes many or all of 
the elements described above relative to the personal com- 
puter 720, although only a memory storage device 750 has 
been illustrated in FIG. 7. The logical connections depicted 
in FIG. 7 include a local area network (LAN) 751 and a wide 
area network (WAN) 752. Such networking environments 
are commonplace in offices, enterprise-wide computer 
networks, intranets and the Internet. 

When used in a LAN networking environment, the per- 
sonal computer 720 is connected to the local network 751 
through a network interface or adapter 753. When used in a 
WAN networking environment, the personal computer 720 
typically includes a modem 754 or other means for estab- 
lishing communications over the wide area network 752, 
such as the Internet. The modem 754, which may be internal 
or external, is connected to the system bus 723 via the serial 
port interface 746. In a networked environment, program 
modules depicted relative to the personal computer 720, or 
portions thereof, may be stored in the remote memory 
storage device. It will be appreciated that the network 
connections shown are exemplary and other means of estab- 
lishing a communications link between the computers may 
be used. 

Although the present invention is described in connection 
with certain specific embodiments for instructional 
purposes, the present invention is not limited thereto. Broad- 
cast television formats other than the NTSC format can be 
employed including: the Phase Alternate Lines (PAL) 
format, the Sequential Couleur Avec Memoire (SECAM) 
format, and the High Definition Television (HDTV) or 
digital television format. The invention is applicable to both 
interlaced scanning systems and progressive scanning sys- 
tems. Software that carries out steps of methods in accor- 
dance with the present invention can be stored on a 
computer-readable medium. Examples of computer- 
readable mediums include magnetic and optical storage 
media and semiconductor memory. Web page content can be 
stored in local storage under a filename (or name of another 
data structure) that does not include the actual resource 
identifier itself, but rather the resource identifier is usable to 
look up the filename (or name of another data structure) 
where the web page content is stored. An information 
resource can involve information other than HTML code. 
Audio data can be included in information resources so that 
dialog in a second language can be heard along with the 
television video in accordance with aspects of the present 
invention. The invention is applicable to numerous broad- 
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cast communication channels including radio, cable, digital 
packet networks, digital terrestrial television, high definition 
television (HDTV), and satellite broadcast channels. The 
broadcast communication channel can be a radio channel 
and the receiver unit can be a radio that is coupled to receive 
information resources from a packet-switched network. 
Information in information resources can be in any suitable 
form including HTML, XML, Java programs, audio data, 
and images. Accordingly, various modifications, 
adaptations, and combinations of various features of the 
described embodiments can be practiced without departing 
from the scope of the invention as set forth in the claims. 
What is claimed is: 

1. In a receiver unit, a method for increasing the likeli- 
hood that a referenced information resource is received, the 
method comprising: 

a. monitoring a broadcast communication channel for 
information resources, and if the information resource 
is received determining if the information resource is to 
be stored in local storage at the receiver unit; 

b. receiving a resource identifier from the broadcast 
communication channel that can be used to reference 
the information resource both at local storage and at a 
packet-switched network that is network connectable to 
the receiver unit; 

c. determining, based on the resource identifier, if the 
information resource is present in the local storage; and 

d. when it is determined that the information resource is 
not present in the local storage, then using the resource 
identifier to request the information resource from the 
packet-switched network. 

2. The method of claim 1, wherein monitoring the broad- 
cast communication channel comprises monitoring a one- 
way broadcast communication channel. 

3. The method of claim 1, wherein monitoring the broad- 
cast communication channel comprises monitoring a packet- 
switched network. 

4. The method of claim 2, wherein the information 
resource is broadcast on the one-way broadcast communi- 
cation channel but the information resource is not received 
by the receiver unit in step (a), and wherein the receiver unit 
retrieves the information resource from the packet-switched 
network in step (d). 

5. The method of claim 2, wherein the information 
resource is not broadcast on the one-way broadcast com- 
munication channel. 

6. The method of claim 2, wherein step (a) includes: 
the receiver unit determining if the information resource 

from the one-way broadcast communication channel is 
corrupted and if the information resource is corrupted 
the information resource is not stored in the local 
storage. 

7. The method of claim 2, wherein the information 
resource is HTML code or XML code. 

8. The method of claim 2, wherein a first information 
resource is stored in local storage in step (a), a first resource 
identifier that identifies the first information resource being 
received in step (b), it is determined that the first information 
resource is to be retrieved from local storage in step (c), and 
wherein a second information resource is not stored in local 
storage in step (a), a second resource identifier that identifies 
the second information resource being received in step (b), 
the second information resource being requested from the 
packet-switched network in step (d). 

9. The method of claim 2, wherein the one-way broadcast 
communication channel has a first sub-channel and a second 
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sub -channel, the first sub-channel having a higher band- 
width than the second sub-channel, the information resource 
being received over the first sub-channel, the resource 
identifier being received over the second sub -channel. 

10. The method of claim 9, wherein the one-way broad- 
cast communication channel involves an NTSC television 
signal, the NTSC television signal having a plurality of first 
vertical blanking interval (VBI) lines and one second VBI 
line, the information resource being received by the receiver 
unit from the first VBI lines, the resource identifier being 
received by the receiver unit from the second VBI line. 

11. The method of claim 2, wherein the one-way broad- 
cast communication channel is a television channel that is 
broadcast over airwaves. 

12. The method of claim 2, wherein the one-way broad- 
cast communication channel is a television channel that is 
received over a cable network. 

13. The method of claim 2, wherein the one-way broad- 
cast communication channel is a television channel that is 
received from a satellite. 

14. The method of claim 2, wherein the resource identifier 
is a Uniform Resource Locator (URL). 

15. The method of claim 2, wherein the packet-switched 
network is the Internet. 

16. A method, comprising: 

a. receiving a resource identifier on a second sub-channel 
of a one-way broadcast communication channel, the 
one-way broadcast communication channel also having 
a first sub-channel, the first sub-channel being a higher 
speed communication sub -channel than the second 
sub-channel; 

b. determining, based on the resource identifier, if the 
information resource was received on the first sub- 
channel; and 

c. if the information resource was not received from the 
first sub-channel, then obtaining the information 
resource identified by the resource identifier from the 
Internet. 

17. In a computer system having a first receiver unit and 
a second receiver unit, a method, comprising: 

a. receiving at the first receiver unit, web page content that 
was broadcast on a first sub -channel of a one-way 
broadcast television channel; 

b. receiving at both the first receiver unit and the second 
receiver unit, a resource identifier that was broadcast on 
a second sub-channel of the one-way broadcast televi- 
sion channel, wherein the resource identifier can be 
used to reference the web page content from local 
storage at the first receiver unit, from local storage at 
the second receiver unit, and from the Internet and 

c. at the second receiver unit, determining, based on the 
resource identifier received on the second sub-channel, 
that the web content broadcast on the first sub-channel 
was not received and using resource identifier to 
request the web page content from the Internet. 

18. The method of claim 17, wherein the web page 
content is hypertext mark-up language (HTML) or exten- 
sible mark-up language (XML) code, and wherein the 
resource identifier is a Uniform Resource Locator (URL). 

19. The method of claim 17, wherein television video is 
broadcast on the one-way broadcast television channel, and 
wherein both the first receiver unit and the second receiver 
unit display the web page content concurrently with the 
television video. 

20. A receiver unit, comprising: 

means for receiving a web page content from a first 
sub-channel of a one-way broadcast communication 
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channel, and for storing the web page content received 
from the first sub-channel in local storage on the 
receiver unit in association with a resource identifier, 
wherein the resource identifier can be used to reference 
the web page content from both local storage and from 
the Internet; 

means for receiving the resoure identifier from a second 
sub-channel of the one-way broadcast communication 
channel, the first sub-channel being a higher speed 
sub-channel than the second sub-channel; and 

means for retrieving the web page content from the local 
storage according to the association between the web 
page content and the resource identifier if the web page 
content is present in local storage, and for using the 
resource identifier to retrieve the web page content 
from the Internet if the web page content is not present 
in local storage on the receiver. 

21. The receiver unit of claim 20, wherein the web page 
content is hypertext mark-up language (HTML) code, 
wherein the resource identifier is a Uniform Resource Loca- 
tor (URL) that identifies the web page content on the World 
Wide Web, and wherein the receiver unit receives the 
one-way broadcast communication channel over a cable, the 
receiver unit also retrieving the web page content from the 
Internet over the cable. 

22. A system, comprising: 

means for broadcasting an information resource on a first 
sub-channel of a one-way broadcast television channel, 
and for broadcasting a resource identifier on a second 
sub-channel of the one-way broadcast television 
channel, the first sub-channel being a higher speed 
sub-channel than the second sub-channel; and 

a receiver unit, comprising: 
local storage; and 

means for receiving the resource identifiers, which can 
be used to reference an information resource from 
both the local storage and from the Internet, from the 
second sub-channel, and for using the resource iden- 
tifier to retrieve the information resource from the 
Internet if the information resource is not present in 
the local storage of the receiver unit, but for using the 
resource identifier to retrieve the information 
resource from the local storage if the information 
resource is present in the local storage of the receiver 
unit. 

23. A computer program product, comprising a computer 
readable medium having computer-executable instructions 
for performing the steps of: 

a. if a web page content is received at a receiver unit from 
a one-way broadcast communication channel, then 
obtaining the web page content from the broadcast 
communication channel and storing the web page con- 
tent in local storage at the receiver unit; 

b. receiving a resource identifier, which can be used to 
reference the web page content from both the local 
storage and the from the Internet, from the one-way 
broadcast communication channel; 

c. if the web page content is present in the local storage, 
then using the resource identifier to retrieve the web 
page content from the local storage; and 

d. if the web page content is not present in the local 
storage, then using the resource identifier to retrieve the 
web page content from the Internet. 

24. In a receiver unit, a method, comprising: 
receiving a web page content on a first sub-channel of a 

one-way broadcast television channel, receiving a 
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resource identifier on a second sub-channel of a one- 
way broadcast television channel, and receiving tele- 
vision video over the one-way broadcast television 
channel, wherein the resource identifier can be used to 
reference web page content from both local storage and 
from the Internet, the first sub -channel being a higher 
speed sub-channel than the second sub-channel; 

recording the television video along with the resource 
identifier onto a magnetic medium; and 

playing back the television video from the magnetic 
medium and using the resource identifier stored on the 
magnetic medium to retrieve the web page content 
identified by the resource identifier from the Internet, 
and displaying the web page content along with the 
television video. 

25. The method of claim 24, wherein the magnetic 
medium is a magnetic tape contained within a cassette. 

26. The method of claim 24, wherein the magnetic 
medium is a magnetic tape of a VHS cassette. 

27. In a receiver unit, a method, comprising: 
receiving television video from a broadcast communica- 
tion channel; 

receiving a first version of an information resource from 
the broadcast communication channel and storing the 
information resource in local storage; 

receiving a resource identifier from the broadcast com- 
munication channel, wherein the resource identifier can 
identify an information resource from both the local 
storage and from the Internet, such that the first version 
of the information resource in the local storage is 
identified by the resource identifier; 

using the resource identifier to access the first version of 
the information resource from local storage; 

determining whether the first version of the information 
resource has a characteristic; 

if the first version of the information resource stored in the 
local storage is not determined to have the 
characteristic, then using the resource identifier to 
request a second version of the information resource 
from the Internet and displaying information from the 
second version of the information resource concur- 
rently with the television video received from the 
broadcast communication channel; and 

if the first version of the information resource stored in the 
local storage is determined to have the characteristic, 
then displaying the first version of the information 
resource concurrently with the television video 
received from the broadcast communication channel. 

28. The method of claim 27, wherein the first version of 
the information resource has a time stamp that is stored in 
the local storage, and wherein the step of determining 
whether the first version of the information resource stored 
in the local storage has a characteristic involves comparing 
the time stamp to a current time. 

29. The method of claim 27, wherein the characteristic is 
having an expiration date stamp that has not expired. 

30. The method of claim 27, wherein the first version of 
the information resource includes web content, wherein the 
second version of the information resource includes web 
content, and wherein the resource identifier is usable to 
locate both the first version of the information resource 
stored in the local storage as well as the second version of 
the information resource on the Internet. 
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UNITED STATES PATENT AND TRADEMARK OFFICE 

CERTIFICATE OF CORRECTION 

PATENT NO. : 6,571,392 Bl Page 1 of 1 

DATED : May 27, 2003 

INVENTOR(S) : Daniel J. Zigmond and Dean J. Blackketter 

It is certified that error appears in the above-identified patent and that said Letters Patent is 
hereby corrected as shown below: 

Column 1, 

Line 22, after "controls the electron beam" delete "-" 
Line 38, after "synchronize" delete "." 

Column 2, 

Line 3, after "of the field are" delete "therefbre" and insert therefore « 
Line 33, after "thirty-six" delete "." 

Column 3, 

Line 17, after "Locator" delete "*" 

Line 30, after "content is to" insert - be ~ 

Column 8, 

Line 52, after "changes are not" delete "successfuilly" and insert -- successfully -- 
Column 9, 

Line 3, after "finer grain" delete "changes" and insert - changes - 

Line 5, after "In A Data" delete "SErvice" and insert - Service - 

Line 57, before "VBI lines" delete "aptures" and insert - captures - 

Line 58, before "does not capture" delete "enerally" and insert ~ generally -- 

Column 14, 

Line 34, after "channel" delete ";and" and insert -- and if so, using the resource 
identifier to retrieve the information resource from a local cache; and -- 

Column 15, 

Line 57, after "storage and" delete "the" 

Signed and Sealed this 
Twenty-third Day of March, 2004 



JON W. DUDAS 
Acting Director of the United States Patent and Trademark Office 
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